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CKOSS-KKPERBNCE TO CD-KOM 

.i, containing a computer program 
^ co^act di.K, whicn i. herein 

Usting is submitted on a =^ P^^ ^^^^^^^^ 

incorporated by "^"J/ duplicates i. two. 

number of compact die ^^^^^^^ specification, 

Appendix A, which contained on the compact 

contains a list of the fUes = ,,i>,ect 
HQtinqs contain material 

disk. These listing ^ ight owner has no 

,c copvrig.. ::r::::L,.e reproduction bv anyone of 
objection to the t ^^^^ disclosure, as it 

,he patent ^..^rnark office patent file 

appears in the patent and copyright rights 

or records, but otherwise reser 

whatsoever. 

BACKGROUND OF THE INVENTION 
0 Field of the invention 

The present invention relates generally to 
[0002] The p particularly, to 

,,^.,er networks and, more pa ^^^^^^^ 

collaborative computing over a 
oescription of the Related «t 

, Traditional collaborative computing tools 
25 100031 "adit locations to 

allow computer users ^^^^^ documents 

communicate via a computer 
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ctored and/or executed on one the 
or applications stored an / ^^__eer and client- 

^o^c, While both peer-to peer 
user's computers. Wh ^^^^ p,3,, 

client-server model. 

i» client-server application 
10004, For example ,-aistributed 
sharing (also discussed xn the 

computing., is ^^^""^ ^.^^^^^^ ,or Control o. 

Broadband and NarrowD classifying and 

aui 170 System for cxass-t y 
Patent No. 5,88/,x ^^^^ Patent No. 

sending Selective Requests , Bandwidth 
^ 038 593 "Remote Application Control 

. „ „ all incorporated herein by 
application f;^^^^^, ,,,3r group 

, reference in their entire ^^^^^^^^^ ^^^^^^ ^^^^ 

communication techniques a j^^^.eased Framework 

and Franz Hauck, "Promondia: A .ava 
,eal-time Group Co-unication .n 

„(= Sixth international Worio v, 
proceedings o£ Six ^^^^^^ ^^^^ ^^^^^ 

20 conference (l^pr - ■ ^ ^^^^^.^^ 
collaboration Into Or. t ^^^^^ ^ ^^^^ 

vol. 21, NO. 9, p. ' J" , Management on the 

-Distributed aava Applets for Pr a ^ 
«eb." IBEB internet Computing 0"-ne. ^ 1^ ^^^^^^^^^ 
,May/.une 19.v> , all incorporated 
in their entireties. 

.tional Telecommunications Union (ITU) 
,00051 open standards that 

Standard T.120 is a family ^.^tions protocols 

.rovides - — Xinrra oo^unications for 
- ::i:r::rarconferencin., among other uses, .his 



704191 vl 



-2- 



-8861 US 



10 



ed in A primer on the T. 120 Ser.e. 
..anaard 1. outlined .n ^^^^^ ^ incorporated 

Standard by DataBeam corp. m y 
herein by reference In .to entirety 

. IS a bloOc diagram illustrating the 

100061 Fig. lA exemplary traditional 

communication scheme used ^ ^^.^^^ 

collaborative computer system^lOO. ^ ^^^^^^ 

,„^.,ers lion (where n = A. 

eerver computers 120n ^^^^^ ^^^^ ,,3 

network 130 (e.g.. ^^^^^^^ d„es not imply 

numeral n appended to aifterent 
any correspondence among ^^^^ 

r-i-ient computer xxu^ 
numerals (e.g.. '^'-^ ^^^^ ^20h) . FiS- * 

relationship to server ^"'"P" communications 
.loo. diagram illustrating the act ^ 

, Channels -^^^^^^^^l^rZ ^ two conferences between 

3.rver computers 120n ^^^^ ,nd 

nsers o£ client computers 1 ^^^^.^^ ^^^^^^^^ 

and HOC and HOD on the ot ^^^^ handled 

from inspection o£ Fig. . ^^^^^ performs 

,0 hy a single server - , small nu*er of 

satisfactorily for oonferenc ^^^.^^ ^^^^^ 

participants and c---;;:^:::, participants in a 
,„leranoe. However, as ^^^^^ ^^^^ 

inference increases furthermore, if the 

25 computer 120n becomes a ^^^^ ^^^^^.^^^ ^ 

particular server computer ^^^.^rence is 

conference — ;„^,,er 120n represents a 
disrupted (r.e.. server system handling 

single point of failure for th ^^^^ 

30 that conference, . ^^J^.^f^.^em. 
improved collaborative computing 
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BRIEF SUMMARY OF THE INVENTION 

invention prov.de a d ^^^^^^^^ ^^^^^ 

system that is .salable ^^,„^,^s the server ae 

- conference .-"--^ syste.. This is 

the single point of failure ^^^^^ 

..complished by providing a P ^i,n-speed 

,,^„,ers interoonnected v.a one or ^^^^^^^^^ 

iinKs. Client '^o^^-J'^^ .inference hosted 

-"-jThir'er ™p.ter to «hioh the oUent 
on either the serve ^^^^ server in the 

computer is — "^ J^ ^^'^ method of the 
system. AS a resu , ^^^^^^^ ^^^^^^^ ^„ 

present inventron rs Y .inference by 

, arbitrary nunO^er of partrc.pants^ ^^^^^ 

--^^ ^n:t:%rerr::rion, by repIicating 
computers to the sy server 

f^r-ence information on more tna 
the conference m present 

,„„pnter. the system and "--^ "'^J^^/ 
,0 invention eliminate the ^ , server 

£ r^-r- Rrt systems . -^ii 
limitation of prxor conference malfunctions, 

hosting or participating xn computers and 

^^i-*=rted by other sexvc 
the failure xs detecte Y ^^^^^^ 

the client computer is able to 

^v, a new server computer. 
25 conference through a new 

BRIEF DESCRIPTION OF THE DRAWINGS 

^r.^ disclosure may be better 
[00081 The present dxscl .^^antages 

^ =>r,d its numerous features 
understood and xts 

xnade apparent to those skxlled 

30 referencing the accompanying drawxngs. 
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. is a bloc^ diagram of a prior art 

100091 Fxg. lA IS 
collaborative computer system- 

.B is a bloc, diagram illustrating 
tOOlOl Fxg. IB elxent 
connections establ.sbe ^^^^^^ 

and server computer of Fxg- 

conferences . 

. ,A is a block diagram of a 
[00111 Fxg. 2A xs ^^„p,ter systems, xn 

invention. 

,B is a block diagram illustrating 

'"""^ "e"ionVestabli..e. between tbe client 
the connections ^^^.^^ ^ 

server con,putere o£ F.g . 

conference. 

. 3 . bloc, aiagra. tbe software 
:! o. Taistributea collaborative 
cont>onents o ^^^^^dance with some 

computer system, « aoco 

^ t-he inventxon. 

embodiments of tne 

4C are flo« diagrams 
,00141 Figs. ^,,,,.ence operation on 

rrtrutr-aborative computer system of 



Fig. 3 



25 



1-he operatxon 
5 is a flow diagram of the P 
[00151 Fxg. 5 xs a 
of the log server of Fig. 3. 

. , i3 a flo. diagram of the operation 
[00161 Fxg. 6 IS a 

license server of Fxg. 3. 



704191 



-5- 



-8861 US 



10 



IB 



„. , ie a now diagram o£ the operation 
[00171 Fig. 7 IS a 
of anApP server of Fig- 3. 

. 3 5 10, and 11 are flow diagrams 
[00181 Fxgs. 8, 9, .^^ the meeting manager 

illustrating the operation of 



of Fig- 3 
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01. c -"-^ • 

. ,2 is a blocK diagram illustrating 
[00191 Fig. 12 server 
the software components of the 
computers of Figs. 2K and 2B. 

, nor are flow diagrams 
13B, and 13C are 
[00201 Figs. 13A, ^^^^^ ^nd 

illustrating the operation of 

App servers of Fig. 3. 

. ,4 is a block diagram illustrating 
[00211 Fig. 14 1 established between 

co^unication -^^^ ^^Z,^^,,, .„-Une 
..ient -P-J - 
conference, m accor 



the invention. 
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tne iiiv<:i^---- 

. 15 a £low diagram o£ an operation 
100221 15 IS a 

£or transmitting data between the 

computers of Fig. 

, and 16B are £low diagram 

'rlrattg a e«p page operation need to 
: n r traLmission o£ pages .etween a 

^-.r's client computer and other 
presenter s cii accordance 

v=' client computers, m 
participants clie .^^.^tion. 
,ith some embodiments of the 

. ,7 is a flow diagram of a client 
[00241 Fig. IJ - ^^^^^^^ 3ome 

browser operation, m 

^ 1-he invention, 
embodiment of tne 
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tOO«l Fxgs. ISA, „i.piayad by 

^ onr are views of weo y^^ 
and 20C are ^ operation of the 

client browser of Fig. 3 tem of Fig. 

distributed collaborative computer 

.the same reference symbols in 
,00261 use of t^e 3 ^^^^^^^^^ 

different drawings indicates 
items . 

.KSC.XPTXO« OK THE X>™B».XO« 

,+--;nn svstem 200, iii cx 
collaborative computing sy computers 

^ t-Vif^ invention. ^-»--^ 
some embodiments of th^ ^ connected to server 

210n (where n = A, B, C - ■ ■ network 130. 

U„U.e in any se^e. co^ut« 

client computer 210 ^^^^ ,<,„nec«d 

-"^'^ /unl 230. High .peed lin^ "° 

through a high-speed ImK security 

allow, .aster throughput and ^ ^-^^^^^^^ 
„ than global-area -tworK 1^ ^ ^^^^^^^^^ „^ „ 

enODodiments high-spee employing 
or optioal carrier-class Ixnk, 

..e v-ell-.no«n SO«BT „,ii readily 

Thaflly ^er equivalent high-speed net.or. 
25 recognize that many standards, may be 

standards, including '^^^^^ 
employed to create a hig 

2B illustrates the connections 
[00281 Fig- 2B i-L-L „„,,ters 210n and server 

established between client computers 
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computers 220n to conduct a conference between 
participants seated at client computers 210A and 210D, 
respectively. First, client computer 210A (whose user 
will host the conference) establishes a connection 225A 
5 to server computer 220A over global-area network 130. 
Server computer 22 OA, in turn, is connected to server 
computer 220B via high-speed link 230. Finally, client 
computer 210D, whose user will join the conference 
hosted by the user of client computer 210A, establishes 
10 a connection 225B to server computer 220B over global- 
area network 130. As a result, information transmitted 
Jo from client computer 21 OA travels through connection 

^ 225A, high-speed link 230 and connection 225B to reach 

fy client computer 210D. Similarly, information 

fQ 15 transmitted from client computer 210D travels through 
^'^ connection 225B, high-speed link 230 and connection 

1=*: 225A to reach client computer 210A. Since high-speed 

Jf; link 23 0 is several orders of magnitude faster than 

>M. connections 225A and 225B, the delay introduced by 

13 20 high-speed link 230 is transparent to the users of 
client computers 210A and 210B. 

[0029] Fig. 3 is a block diagram of the software 

components of a distributed collaborative computer 
system 3 00, in accordance with some embodiments of the 
25 invention. 

[0030] Distributed collaborative computer system 300 
includes meeting zones 310n (where n = A, B, C) , client 
browser 320, web zone 330 and central operation 
database 350. Client browser 320 is a web browser 
30 program executed on one of client computers 210n (Figs. 
2A and 2B) . Client browser 320 first connects to web 
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. s««ing or joining a conference, 
.one 330 to request .tart, g ^^^^ .inference 

-irtn in turn, verii-A ^^^.-.y^ase 340 

web zone 330, m operation database 

.„.or^t.on ana ---^^-^M .erU.e. t.at t.e 
accordingly, once web ^ .inference, client 

..er is aut.ori.ea to start/, ^ ^^^^^^^ „ 
browser 320 connects ^^^^ ^^^^^ 

access the conference. Mee g ^^^^^^^ „„£.ren=e 

connects 7;;:;:l,o„ ..ta.ase 3.0 accordingly, 

and updates central op 

„0 includes a web server 335 that 
1003« allow users to access 

^intains a websrte 300 and a web 

distributed -"-"""""^ , ^,age and administrative 
database 33. that stores ^^^^^^^^ ..naborative 

,„.or.ation -"- -"/J.^.^^ation stored in web 
.5 computer system 300 synchronized and/or 

-"''-^ "^rht^:n o -ion stored in central 
„pUcated w.th tbe ^^^^^^ ^^^^ c„„.istency. 

operation database ^^^^^ ^ 

,„„3„ .ach meeting .one 310^, ^ ^^^^ ^ 
,0 meeting manager 350, a p.ng ^ ^^^^^ 

manager 3eo, a meeting database ^ 
oollaboration (CB, servers 3» '^^^^^^^ ^^^^ 3^,^ also 
eervers 390n. Furthermore ^^^^^^^ 
includes a process j logical servers 

311 is the — the meeting zone, 
running on a physical logical servers 

PM 311 thus monitors the ^^^^^ ^^awns 

and processes running on the pj ^^^^^^^^.^^,y, p„ 311 
replacement „^ £rom remote access 

30 can start new processes 



service ,(EAS) 312. 
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[0033] In one embodiment of the present invention, a 

single instance of meeting zone 3 IDA is implemented on 
one physical server (i.e., one machine). 

[0034] In some embodiments, each meeting zone is 

implemented on a single physical server. One of 
ordinary skill will readily appreciate, however, that 
multiple physical servers could also be used either as 
hot or warm standby units for redundancy or to spread 
the logical server loading across multiple machines, 
each with its own PM. Alternatively, several meeting 
zones could be implemented on one physical server, 
either having their own PM, or sharing a single PM. 

[0035] PM 311 spawns each logical server (e.g., CB 

servers 380A, 380B, 380C; App server 390A, 390B, 390C; 
meeting manager 3 50, ping server 35, log server 3 70, 
and license manager 360) as directed by a startup 
configuration file or operator command through RAS 312. 
RAS 312 is, in some embodiments, a real-time messaging 
service such as TIBCO Rendezvous, available from TIBCO 
Software, Inc. of Palo Alto, CA. 

[0036] Each logical server has its own 

communications and control module known as a zone 
manager (ZM) . Conceptually, each ZM 313 is functionally 
similar although one of ordinary skill in the art will 
appreciate that implementation optimizations may allow 
for reduced functionality in some instances of ZM 313. 

[0037] Meeting manager 350 also possesses a special 
zone manager 314, so designated because it also acts as 
a gatekeeper (GK) for the entity meeting zone 310. The 
GK maintains a subset of the state of each logical 
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server so that meeting manager 3 50 has immediately- 
available the detailed status of the entire meeting 
zone 310. 

[0038] Each ZM, which is spawned (created) in direct 

5 correspondence to each logical server or autonomous 
process on a given physical server machine, monitors 
the health and status of its corresponding logical 
server or process. All logical server communications 
with other logical servers and with the process manager 
10 211 go through the ZM in each logical server and the 
PM. 

[0039] The operational functions of PM 311, RAS 312, 

ZM 313, and ZM/GK 314 are discussed in further detail 
below. 

[0040] All ZMs report to a single "super ZM" , known 

as the gatekeeper or ZM/GK. Each ZM sends a subset of 
its corresponding logical server's state and traffic 
capacity to the ZM/GK so that the GK is aware of the 
status of all elements of the meeting zone. This 
enables the meeting manager to get coordinated zone 
state reports and therefore "know" the status of the 
entire meeting zone. 

[0041] Zone status is important to the meeting 

manager (and thus to the overall health and efficiency 
25 of the zone) because the meeting manager uses ZM/GK 

state reports to manage both the zone' s overall quality 
of service (QoS) and the load balance across all active 
collaboration servers (CBs) in the zone. 
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[0042] QoS, in this context, refers to the zone's 
ability to respond to client data requests of all types 
(e.g., HTTP, application sharing, document sharing, 
telephony, and so forth) . In addition, QoS is an 
5 indirect indicator of latency to those requests, caused 
by high and possibly unbalanced loading of the logical 
servers in the meeting zone. For example, in some 
embodiments of the present invention, a meeting manager 
faced with a need to add more user participants to an 
10 in-progress meeting must determine if an additional CB 
server must be spawned (i.e., brought on-line) to keep 
\g overall CB server loading below a certain threshold. 

This ^^intelligence" in the MM is implemented through 
ru the ZMs in each CB and the coordinating function of the 

m 15 ZM/GK reporting to the MM. The MM can thus decide if 
* the pre-defined QoS for the specific user client 

H (perhaps determined by the time of day, the user's 

ly license, or the type of service purchased by the user 

or some communication thereof, to name but a few 
Q 20 examples) , would be unobtainable without additional CB 
server resources. If so, the meeting manager will 
request that the process manager spawn a new CB server. 

[0043] Once client browser 320 has received 
authorization to start/ join a conference, client 

25 browser 320 attempts to connect to ping servers 355 in 
multiple meeting zones 310n. Client browser 320 selects 
the first ping server to respond to the connection 
request and disconnects other responding ping servers 
355. The selected ping server, in turn, forwards the 

3 0 request to start /join a conference to a meeting manager 
350 in the same meeting zone 310n as the selected ping 
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-,c,o in turn, assigns a CB 
server 3BB. — "/^^^ Conference. The selected 
server 380n to .ost/.andle t.e ^^^^^^^ 

CB server 380n connects t ^^^^erence that the 

o.her CB servers ^BOn .an- n. . ^^^^ ^^^^^^^ 

.3er Wishes ^ ^^-/^^^^^^^ „ 3.0 via the 

communicates with other 
selected CB server 380n. 

J V.,, re servers 380n 
..rvers 390n are used by CB serv 
[00441 APP — 3e„ices such as 
and client browsers 320 to PP ^^^^ 

file sharing, video, 
document view, application sharing. 

.elephonv, polling, ^-'jf^^ J,,„,ces are further 
collaborative support for ^^^^ 

..scribed in the -"J- "^In its entirety^ 
incorporated herein by ...pending and 

.I„3tant Document Sharing, / ^ p^,,,, 
iv assigned Application for a u. 

rr "'""te 

. t Sharing of Documents in a Remote 
-instant sharing ..^cnly-assigned 

server," ,,es Patent Ber. »o. 

Application for unl 

„./4,l,«e, "-^--.";/_^,„,,„,and 
.gemote Document serving, c ^ ^ 

co^^only-assign^ ^PP--;-^^„, ,,.ed .une 
States patent Ser. 

2000. n „f an Unattended 

^^v^ 9 9 2000. 
0,/SlS,.S4, ; ,e„„ections 

-Method for creating facilitate 
over an Xnterconnected Network to 



25 
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25 



states patent Ser. 



30 



OQ 1996 . 

„ !„:t.od for csta.us.in, a co^unica.^a 
0 ixieT:a^^ More Users Via a 

connection Between Two or More _ ^ 

«etwor. o. Xnterconnectea Co.P^« ^ ^^^^^^ 

- ---;Tr/or/:::ec., .ue. on 

states patent Ser. 

persistent connection using HTTP," 
o « Emulating a Persxsten application for 

^.r,a and comtnonly-assxgned App 
co-pendxng and 09/449,011, 
a united States Patent Ser. 
,,XedonHov. 24, 1999- 
. .Method of Transferring ^^^^^^^ ^^^^^^^^ 

T „ /^-f Priorities 
Levels of Pno o^;,tes Patent No. 

M= " United States 
to User Demands, uni 

.,e for virtual screen overlay," 
, -Method to Prov.de for 

/I states patent No. 5, 577, 18" ■ 
United States ,,nited States 

. -collaborative «eb Browser, 

patent No. 5,944."1. 

,arver 370 co^unicates with meeting 
^ , respective .Ms 313 and 314 and 

manager 3S0 via -^^^^J j ^^^^ joining/leaving 

— -formation rela. ^^^^^ ^^^^^^^^ 
conferences and update ^^^^^^^ ^^^^^^ 

manager 360 communicates ^^^^^.^^ 
(again, through ZMs 313 an 14) a^P ^^^^^ 
database 3.0 to -ure ^at ^^^^^^ 
authorized to 30-^ 
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11 fault tolerance is ensured by 
e„„«, overall f aul ^^^^^^^^^ ^ 

p^ovidins P-;-;;;^^^, ..placement, by the PM. « 
correction (e.g.. P ^^^^ ^^/^^ sate 

..e -^--;7-;;r^:..i server faults and .M 
monitoring ^^^^^^ t^„,„,3 . Laical server state 
co^ands to ^P^^/;;^^^^,^, gatekeeper, us.ng 

^plication .s also P ^^^^^^^^ ^^^^^ 

the meeting database. ^ hardware and 

..lerance is provided -^^^ 

rstrtrn;:rco:trol .et^ods „ell-.no«n in the 

art - 

. ,^.4C are flow diagrams illustratrng 
100471 Frgs. " „0 on distributed 

start/join conference 3, . 

, collaborative computer system 300 (Frg 

■ . in stage 402, client browser 320 
e00481 Frrst, rn stag connection is 

connects to a «eb proceeds to stage 

..ccessful (Stage 404. P^^^ ^^^^^^^^ „ 

406, otherwise stages ^^^^ ^„ ,0 

,0 stage 406, the user of clr .^,,^,,on entered 

Tn stage 40b, i-^^^ 
.eb server 335 in 9 ^^^^^^^,^,,3, 

by the user in stage 4U 

• «^ored in web database 337. 
information storea n 

^ v.^7 the user cannot be 
information e--- t 

,5 authenticated, stages ^^^^ successfully 

the information entered y browser 320 is 

. . Tn some embodiments, client o 
validated In som ^^^^^^^^^^ of login 

rtrtrrrlnt unauthori^d a^=es- «eb .rver 

techniques tor 
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V. ..e these techniques are not further 
to a WebSite, tnesti 

discussed herein. 

the user has successfully logged on to 
°Zs stage «0 determines whether the user 
„eb — « "^'/'^/^^ , conference or Join an 

reguestrng to start ^^^^ „<5uesting to Join 

existing ^^^^Tl^^^^^^r. 400 proceeds to stage 
, new . p,„,eeds to stage 450. 

otherwise operation 400 p 

„, in stage 412, meeting parameters are 
100501 Ih Btag through web 

extracted from meeting ,,,,„t 

database 33V. m /^^^ J^^.ter 210n (Figs. 

^„„3er 320 is launched on clien ^^^^^^ ^^^^^^^ 

and 2B) . The first trme the use 

3.0 connects to ^Z J^^^^^^^ -^""^^^ 

, downloaded over ^^^^^^'^^ ,,ter the plug-in is 
on the client computer 210n. ^£ 
..stalled on Client 

,or subse^ent conferences "--- '^^^^^ .^diments, 
downloading and -----^ ,.ed over time: 

.0 multiple versions "^ '^J ^ available on 

when a new version of the p g ^^^^^^ client 

. „eb server 33S, the new P^"^;-;; ,,,,, 
computer 210n and installed in place 
version of the plug-in. 

. stage 416, the meeting parameters are sent 
100511 in stage 41 , ^^^^^^^^ ^3,, 

from meeting database proceeds to 

.-.T 710n and operation 4U<J V 
client computer 2iun o 

stage 418 (Fig. 4B) . 

4,3 client browser 320 attempts to 
[00521 in stage 413, 
30 connect to any available ping server 35 



-16- 

704X91 vl 



M-8861 US 



ved from one or n»re ping servers 
responses are received £ro ^^^^.^^^ 

335. in some embodiments .£ ^„ 
„i..in a predefined time ^^^^^^ 3,,,,, t.e 

..peated until a "-7;^ : ",,,,„ed time iimit. 
ori.inai -/^^ J, ,.3test pin. server 3SS 

Client browser 320 ^^^^^^ „<i 

,0 respond to the connection req ^^^^^^ 
aisconnects the non-selected P^^J^ . 

Qon then sends a j^^h^^ 
4„) . Client browser 320 

meetin. to the selected prn. er^er ^ 

p.n. server 3SS ^'^^^^^^^ J^,, „eetin. zone 

„,,,ger («M) 350 (stage 428) .n 
310n (Fig. 3) as ping server 355. 

^ci- 1-0 ioin a meeting, 
TrrecraTirrratLn ,ce> server 
S meeting manager 350 3 son in the 

3e0n from a pool of avaxlabl ^^^^^ ^^^^ ^ 

meeting zone 3X0n (stage ^ ^^^^^ ^^^^^^ 

selected CB — ^„ ..certain which CB 
330n in all ^-^^^ ^^h^ which the user of 

" server 3B0n s - " J^^^^^^.^^ .„»ect . once 

client browser ^^^.^^ ^3„er 

client CB server 380n locates ^^^^^^ 

t-v>e^ hosting CB sej.v<= 
380n, it connects to the h ^^^^ 

n • »- TR server 3 8 On then tnaKes 
434). Client CB serv 

H=»t-a from hosting CB serve 
25 the meeting data rro 

,,>„=.i-her meeting manager 
c=taae 438 determines whether m ^ . ^ 

t0054l Stage 4 ,,,fi,,ation from client CB 

3,, received a .ee.i g ^^^^^^^ ^^^^^^^^ 

3erver 380n, m ^^^3.^33 repeated with a 

stage 440. Otherwise stages 
30 new client CB server 380n. 
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[0055] In stage 440, meeting manager 350 has 

received confirmation from CB seirver 380n that a 
connection has been successfully established with the 
hosting CB server 3 80n. The confirmation is then 
5 transmitted from meeting manager 350 to ping server 355 
and from ping server 355 to client browser 320 (stage 
442) . 

[0056] If the user requests starting a new meeting 

in stage 410, operation 400 proceeds to stages 450-472. 
Stages 450-466 are analogous to stages 414-430 and 
stages 468-472 are analogous to stages 438-442, except 
that if stage 468 fails, operation 400 proceeds to 
stage 454 rather than stage 418. 

[0057] Fig. 5 is a flow diagram of the operation 500 

of log searver 370 of Fig. 3. In operation 500, stage 
510 determines whether a new log entry has been posted 
and stage 52 0 updates meeting database 365 (Fig. 3) . 

[0058] Fig. 6 is a flow diagram of the operation 600 

of license server 360 of Fig. 3. First, stage 610 
determines if a new user has requested joining the 
meeting, in which case operation 600 proceeds to stage 
620. Otherwise, stage 610 is repeated. In stage 620, 
license manager 3 60 compares the number of users in the 
meeting if the current user were allowed to join the 
meeting to the user limit for the meeting. Stage 63 0 
then determines whether the user limit is exceed, in 
which case CB server 380n is notified (stage 640) . 
Otherwise stages 610-630 are repeated. 

[0059] Fig. 7 is a flow diagram of the operation 700 

30 of an application (App) server 390n of Fig. 3. First, 
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,„.e..nea .... iTr. .aUu.e ae.e<=..on 

,,Uure of a CB se ^^^^ ,..o.ain,ly, the 

embodiments of tne p particular 
present invention is not l.mxted 
failure detection technique. 

V ..f the present invention, 

meeting manager 3=0 emp V 

seating .one gatekeeper, (ZM/GK, ^^^^ 
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30 recovers its state information (e.g.. 
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. ... configuration, operating or quality of 
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process communication arts. In other embodiments, the 
WebEx Transport Layer protocol is used. 

[0068] The WebEx Transport Layer protocol (TP) is 
responsible for providing point-to-point connectivity 
5 between a WebEx client and the WebEx server. The TP 

layer will attempt to create direct TCP connections and 
use TCP to communicate between the client and se2rver. 
For clients that sit behind firewalls, particularly for 
those that are unable ^to create direct TCP connections, 
10 the WebEx TP layer will automatically create virtual 
sockets based upon HTTP. This enables the client to 
communicate with the server through most firewalls. 

[0069] Since the HTTP protocol functions on a 

Request/Response basis, it is always the client that 

15 issues the Request command. Hence, in order to provide 
a bi-directional communication channel, the client 
actively polls the server in order to fetch the data 
that may be sent from the server to the client. The 
details of this implementation are available in the co- 

2 0 pending and commonly-assigned Application for a United 
States Patent Ser. No. 09/449,011, filed on Nov. 24, 
1999, ''Emulating a Persistent Connection Using HTTP," 
cited and incorporated above. 

[0070] If a failure of App seirver 390n is detected, 

25 operation 900 proceeds to stage 920. Otherwise stage 
910 is repeated. In stage 920, meeting manager 350 
places any CB servers 380n connected to failed App 
server 3 90n in a suspend state and receives a request 
for a new App server 390n from CB server 380n in stage 
30 930. Meeting manager 350 then requests that process 
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manager 311 launch a new App server 3 9 On (stage 940) . 
Process manager 311 launches the new App server 3 90n 
and notifies meeting manager 350 (stage 950) . 

[0071] Once meeting manager 350 has received 
5 notification that the new App server 3 90n has been 
launched, meeting manager 350 resumes (i.e., removes 
from the suspend state) CB server 380n and connects it 
to the new App server 390n. (App server state is 
restored from a backup meeting manager, through any of 
10 a number of standard and common means well-known in the 
art.) Meeting manager continues to monitor the status 
of App searver 390n (stage 910) . Note that all logical 
server -to -logical server and logical server- to -PM 
communications employ ZMs 313 and 314. 

15 [0072] Fig. 10 illustrates the license/log manager 

failure detection and recovery operation 1000 . First , 
meeting manager 3 50 checks whether license manager 3 60 
or log server 370 have failed, using similar techniques 
to the ones described above in reference to Figs . 8 and 

20 9. If a failure is detected, operation 1000 proceeds to 
stage 1020. Otherwise, stage 1010 is repeated until a 
failure is detected. Meeting manager 350, in turn, 
sends a request to process manager 311 to launch a new 
license manager 360 or log server 370 (stage 1020) , as 

25 required. Stage 1030 then determines whether the new 

license manager 360 or log server 370 has successfully 
come on-line, in which case meeting manager 350 
continues to monitor the status of license manager 360 
and log server 370 (stage 1010) . Otherwise, stages 1030 

30 and 1040 are repeated until a new license manager 360 
or log server 370 has been successfully started . 
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[0073] Note that the reliable TP layer keeps all 

data and resends/reloads it into the replacement 
license and/or log server as needed. 

[0074] Figs. 8-10 thus show how meeting manager 35 0 

5 monitors the status of other components in its meeting 
zone 31 On. However, to provide even more effective 
fault tolerance, the status of meeting manager 350 must 
also be monitored to prevent a single point of failure 
in the system. This is accomplished by providing both a 

10 primary and one or more standby meeting managers 3 50 in 
each meeting zone 310n. In addition, process manager 
311 is responsible for detecting failure of the primary 
meeting manager 350 and transferring control to one of 
the backup meeting managers 350. Operability of the 

15 process manager, in turn, is guaranteed by a hardware 
time-out restart process. 

[0075] Fig. 11 illustrates meeting manager failure 

detection and recovery operation 1100. In each meeting 
zone 310n (referring to Fig. 3), there is instantiated 

2 0 one primary meeting manager 3 50 and one or more 

secondary meeting managers (not shown) . Process manager 
311 continually checks whether primary meeting manager 
350 has failed (stage 1110) , again using standard 
failure detection techniques. If a failure of primary 
25 meeting manager 350 is in fact detected, operation 1110 
proceeds to stage 1120. Otherwise, stage 1110 is 
repeated. 

[0076] In stage 1120, process manager 311 launches a 

new standby meeting manager. The pre-existing standby 

3 0 meeting managers, advised of the failure of primary 
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meeting manager by process manager 311, elect (through 
any of several well-known ser*ver election or promotion 
mechanisms) one of their own (step 1140) to take over 
as primary and broadcast an election message (stage 
5 1140) . One of the standby meeting managers is thus 

selected as the new primary meeting manager 3 50 (stage 
1150) . In the event only one standby MM is presently 
configured, the election message of stage 1140 is 
simply construed as a command to become the primary MM. 

10 [0077] The standby meeting manager (s) 350, CB 

servers 3 8 On, App server 3 90n, ping servers 355, 
license manager 3 60, and log server 3 70 in the same 
meeting zone 31 On as new primary meeting manager 3 50 
connect to new primary meeting manager 350 (stage 116 0) 

15 and register with it (stage 1170) so that the new 

primary meeting manager can continue to monitor the 
status of these servers. New primary meeting manager 
350 recovers its server state (stage 1180) and receives 
reports from CB servers 380n on the status of any 

2 0 active conferences handled by CB servers 3 8 On (stage 
1190) . Finally, new primary meeting manager 350 
recovers meeting information for all meetings handled 
in the meeting zone 310n (stage 1190) . Process manager 
311 monitors the status of new primary meeting manager 

25 350 (stage 1110) . 

[0078] CB server 380n interfaces with client browser 

320 through application protocol entities (APEs) joined 
to agent sessions. Fig. 12 is a block diagram 
illustrating the software components of client 
30 computers 210n and server computers 220n (Figs. 2A and 
2B) involved in the communications between CB server 
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380n and client browser 320. In particular, 
communications channels are established between 
transaction processing (TP) server 1250 and Application 
Resource Manager (ARM) server 124 0 on server computer 
5 220n and TP client 1230 and ARM client 1220 on client 
computer 21 On. Thus, conference manager 12 60 and App 
server 390n (both logically part of CB server 380n) 
communicate with client computer 210n via the 
communication channels maintained by ARM server 1240 
10 and TP server 1250. 

[0079] Figs. 13A-13C are flow diagrams illustrating 

the operation 1300 of CB server 380n and App server 
3 90n to setup communications with client browser 32 0 
(Fig. 3). First, CB server 380n creates an agent 

15 session (stage 1305) . The agent session controls 

communications from client computer 210n to CB server 
380n and can launch new, additional data sessions if 
required. To communicate with CB server 380n, client 
computer 210n, in turn, creates an APE (stage 1310) and 

20 joins the APE to the agent session (stage 1315) . In 

stage 1316, CB server 380n sends a list of all existing 
session to the client computer 210n; in stage 1317, the 
client must chose whether to join all or only some 
sessions. If client computer 210n joins all sessions, 

25 control passes to stage 1320, shown in Fig. 13B. If 
not, stage 1318, the client joins only selected 
sessions before control passes to stage 132 0 . 

[0080] Stage 1320 (Fig. 13B) determines whether the 

user of client computer 210n has elected to create a 
30 new session (e.g., to share an application), in which 
case operation 1300 proceeds to stage 1325. Otherwise, 
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operation 1300 proceeds to stage 1360. Client computer 
210n APE then sends a message to the agent session APE 
of CB server 380n requesting a new session (stage 
1325) . CB server 380n, in turn, requests a new session 
5 from App server 390n (stage 1330) and App server 390n 
creates the new session for the conference (stage 
1335) . App server 3 90n also creates a new APE and joins 
the new session to the new APE (stage 1340) . CB server 
380n, in turn, sends the new session's ID to client 
10 computer 210n (stage 1345) . Client computer 210n 

launches an application (stage 1350) , creates a new APE 
for the application and joins the new APE to the new 
session (stage 1355, referring to Fig. 13C) . 

[0081] Stage 1360 determines if a new client 

15 computer 210n wants to join an existing session, in 
which case operation 1300 proceeds to stage 1370. 
Otherwise, operation 1300 terminates. Client computer 
210n requests joining the session (stage 1370) , 
concluding operation 1300. 

20 [0082] Fig. 14 is a block diagram illustrating the 

communication channels established between client 
computers 210A and 210B during an on-line conference, 
in accordance with an embodiment of the invention. 
Client computer 210A connects to CB server 380B in 

2 5 meeting zone 31 OA via ARM server 124 0 and TP server 

1250. In addition, CB server 380B established a high- 
speed real-time messaging link 1420 with CB server 380C 
in meeting zone 31 OB using a real-time messaging 
service (RTMS) 1410. In one embodiment of the present 

30 invention, RTMS 1410 is implemented using the well- 
known TCP/IP communications protocol. In some alternate 
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embodiments , the WebEx Transport Protocol , discussed 
above, is used. 

[0083] CB server 380C, in turn, connects to client 

computer 210B via its own ARM server 124 0 and TP server 
5 12 50 (not shown) . 

[0084] Fig. 15 is a flow diagram of operation 1500 

for transmitting data from client computer 210A to 
client computer 210B using distributed collaborative 
computer system 300 (Fig. 3). First, CB server 380B 

10 establishes a link to CB server 380C using real-time 
messaging service 1410 (stage 1510, as illustrated in 
Fig. 14) . The session information is then replicated 
from CB server 380B to CB server 380C (stage 1520) . 
Data routed from client computer 210A is then 

15 transmitted from CB server 380B to CB server 380C over 
real-time .messaging service 1410 (stage 1530) . The data 
received by CB server 380C is then routed to client 
computer 210B using TP server 1250 (stage 1540) . Stage 
1550 then determines if additional data needs to be 

20 transmitted from client computers 210A and 210B, in 
which case stages 1530-1550 are repeated. Otherwise, 
operation 1500 terminates . 

[0085] Distributed collaborative computer system 300 

allows users of client computers 210n to participate in 

2 5 on-line conferences by sharing both audio and video 

signals. In particular, distributed collaborative 
computer system 300 allows users to share images of a 
document that can be marked-up by conference 
participants (document viewing) . Document viewing is 

3 0 described in further detail in United States Patent No. 
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5,577,188 "Method to Provide for Virtual Screen 
Overlay" and co-pending and commonly-assigned United 
States Patent Application Ser. Nos . 09/471,938 and 
09/591,377 (filed on Dec. 23, 1999 and June 9, 2000, 
5 respectively), cited and incorporated above. In 

addition, users may share control of an application 
program executed on any of the client computers 21 On 
participating in the on-line conference (a process 
known as application sharing) . Application sharing is 
10 described in further detail in co-pending and commonly- 
assigned U.S. Patent Application Ser. No. 09/442,424 
(filed Nov. 17, 1999), cited and incorporated above. 

[0086] During document viewing, the presenter may 

choose to skip one or more pages in the document being 
15 viewed. Figs. 16A and 16B are flow diagram illustrating 
the skip page operation 16 00 used to control 
transmission of pages between the presenter's client 
computer 210n and other participants' client computers 
210n. 

20 ' [0087] First, an App server 390n providing the 

document viewing application (also referred to as the 
docview server) assigns unique IDs to each page in the 
document being viewed (stage 1605, Fig. 16A) . The page 
IDs and page content data are then passed to ARM client 

25 1220 and from ARM client 1220 to ARM server 1240 (stage 
1610). ARM server 1240, in turn, begins transmitting 
the document page IDs and data over a shared data queue 
on high-speed real-time messaging link 1420 (stage 
1615) . The first page ID is then sent to all client 

30 computers 210n connected to the conference (stage 
1620) . Client computers 210n, in turn, request the 
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first page data from the shared data queue (stage 1625) 
and CB server 380n sends the first page data to client 
computers 210n (stage 1630) . Stage 1635 then determines 
whether the presenter has elected to jump to a new page 
5 in the shared document, in which case operation 1600 
proceeds to stage 1640. Otherwise, operation 1600 
proceeds to stage 1655. In stage 1640 (Fig. 16B) , the 
presenter's client computer 210n broadcasts the new 
page ID to all client computers 210n participating in 
10 the conference. The new page data is then transmitted 
over the shared data queue (stage 1645) and client 
computers 21 On request the new page from the shared 
media queue (stage 1650) . 

[0088] Alternatively, stage 1655 determines if all 
15 data transmitted on the shared data queue has been 

received, in which case the docview server is notified 

(stage 1660. Otherwise, operation 1600 proceeds to 
stage 1635. 

[0089] Stage 1665, in turn, determines whether the 

2 0 shared data queue is no longer needed, in which case 
the shared data queue is emptied (stage 1670) and 
operation 1600 terminates. Otherwise, operation 1600 
proceeds to stage 1635. 

[0090] Fig. 17 is a flow diagram of a client browser 

25 operation 1700, in accordance with some embodiments of 
the invention. First, client browser 32 0 receives 
conference parameters from CB server 380n (stage 1710) . 
Client browser 32 0 then connects to CB server 380n 
(stage 1720) to participate in the conference. Stage 
30 1730 checks the status of CB server 380n. If a failure 
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of CB server 380n is detected, client browser 320 
attempts to reconnect to a new CB server 380n (stage 
1740) and stages 1710-1730 are repeated. Otherwise, 
client browser 320 continues to monitor the status of 
CB server 3 8 On. 

[0091] Figs. 18A, 18B, 18C1-3, 19A, 19B, 20A, 20B 

and 2 0C are views of web pages displayed by client 
browser 32 0 (Fig. 3) during operation of distributed 
collaborative computer system 300. 

[0092] Meeting center web page 1800 (Figs. 18A, 18B 

and 18C1-3) is displayed when a user first accesses web 
server 335 (Fig. 3) through client browser 32 0. 
Meeting center web page 1800 contains a list of current 
and scheduled meetings the user may want to join. In 
addition, the user may create a new meeting by 
selecting create meeting button 1810, causing a sign in 
prompt to be displayed in meeting center web page 1800 
(Fig. 18B) . If the user is not already registered with 
the service , the user can register by selecting new 
user link 1820. Otherwise, the user can enter ID and 
password information in login prompt 183 0 . If the 
user' s data is successfully authenticated with the 
information stored in web database 337 and/or central 
operation database 340 (Fig. 3), a create new meeting 
prompt 184 0 is displayed in meeting center web page 
1800 (Figs. 18C1-3). The user can then enter meeting 
parameters such as date, time, and attendee list by 
filling in new meeting prompt 1840. The user can also 
edit meeting options by selecting edit options button 
1850, thereby causing meeting options web page 1900 
(Figs. 19A-19B) to be displayed. Once the user has 
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entered the desired meeting information on meeting, 
center web page 1800, the user can either schedule the 
meeting by pressing schedule button 1860 or start the 
meeting by pressing start now button 1870. 

[0093] Meeting options web page 1900 allows the user 
to set specific meeting options such as features, 
client type, frequency and reminders. Once the user is 
satisfied with the selected options, the user can 
return to meeting center web page 1800 by pressing 
submit button 1910. 

[0094] Meeting web page 2000 (Figs. 20A-20C) is 

displayed to the user during a meeting. Meeting web 
page 2 00 0 includes a shared pane 2 010, an attendee pane 
2020 and a message pane 2030. Information shared among 
meeting participants are displayed in shared pane 2010. 
The user can share images, documents, applications, web 
pages, desktops and whiteboards by selecting an 
appropriate entry from tools menu 2040 (Fig. 20B) . For 
example, if the user selects to share an image to be 
marked up by the meeting participants, the image is 
displayed in shared pane 2010 (Fig. 20C) . One or more 
users can then mark up the image by selecting a drawing 
tool from drawing menu 2 050 and drawing over the image. 
Attendee pane 2020 contains a list of meeting 
attendees. Alternatively, attendee pane 2020 can used 
to display polls taken among the meeting attendees or a 
video conferencing images. Finally, message pane 2030 
can used to compose, send and receive messages among 
two or more meeting attendees. 
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[0095] Since conference information is replicated 

across all CB servers 380n handling the conference and 
can be reconstructed by meeting manager 350, failure of 
one or more CB ser*vers 3 8 On does not disrupt the 
conference and can be gracefully recovered. As a 
result, the distributed collaborative computing system 
of the present invention eliminates the single point of 
failure limitation of prior art collaborative computing 
systems. In addition, since multiple server computers 
220n are used to handle an on-line conference, the 
distributed collaborative computing system of the 
present invention may handle conferences with an 
arbitrary number of participants, without any 
limitations imposed by the processing capacity of any 
single server computer. By contrast, prior art systems 
were limited to conferences whose participants could 
all be handled by a single server computer. 

Alternate Embodiments 

[0096] The order in which the steps of the present 

method are performed is purely illustrative in nature . 
In fact, the steps can be performed in any order or in 
parallel, unless otherwise indicated by the present 
disclosure . 

[0097] The method of the present invention may be 

performed in either hardware, software, or any 
combination thereof, as those terms are currently known 
in the art. In particular, the present method may be 
carried out by software, firmware, or microcode 
operating on a computer or computers of any type. 
Additionally, software embodying the present invention 
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may comprise computer instructions in any form (e.g., 
source code, object code, interpreted code, etc.) 
stored in any computer- readable medium (e.g., ROM, RAM, 
magnetic media, punched tape or card, compact disc (CD) 
5 in any form, DVD, etc.). Furthermore, such software may 
also be in the form of a computer data signal embodied 
in a carrier wave, such as that found within the well- 
known Web pages transferred among computers connected 
to the Internet. Accordingly, the present invention is 
10 not limited to any particular platform, unless 
specifically stated otherwise in the present 
disclosure. i 

[0098] While particular embodiments of the present 

invention have been shown and described, it will be 

15 apparent to those skilled in the art that changes and 
modifications may be made without departing from this 
invention in its broader aspect and, therefore, the 
appended claims are to encompass within their scope all 
such changes and modifications as fall within the true 

20 spirit of this invention. 
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